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The effects of method of reproduction, status cf 
researcher and personalization of signature on the initial rate of 
return of maxl questionnaires vere investigated, using a cne^page 
combination cover letter and questionnaire mailed to 200 full 
professors, 200 associate professors and 200 assistant professors at 
the University of Maryland, College Park. The levels of each 
experimental variable were: status (professor, graduate student); 
signature (hand signed in ink, mimiographed facsimile) ; reproduction 
(typed, photocopied, mimiographed), A response rate of 69% vas 
obtained, without using any follow-up procedures* Chi square analyses 
indicated no significant differences in the rate of returns for the 
levels of any of the experimental variables. It appears that icitial 
return rate will not be significantly affected by using the most 
efficient, least expensive method available. (Author) 
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INITIAL RETURNS ON MAIL QUESTIONNAIRES: A LITERATURE REVIEW AND RESEARCH NOTE 

Joseph L. Horowitz and William E. Sedlacek 
Research Report # 10-73 

SUMMARY 

The effects of method of reproduction, status of researcher and personal- 
ization of signature on the initial rate of return of mail questionnaires 
were investigated, using a one-page combination cover letter and questionnaire 
mailed to 200 full professors, 200 associate professors and 200 assistant 
professors at the University of Maryland, College Park. The levels of each 
experimental variable were: Status — professor, graduate student; signature - 
hand signed in ink, mimeographed facsimile; reproduction -- typed, photocopied, 
mimeographed. 

A response rate of 69% • was obtained, without using any follow-up pro- 
cedures. Chi square analyses indicated no significant differences in the rate 
of returns for the levels of any of the experimental variables. 

It appears that initial return rate will not be significantly affected by 
using the most efficient, least expensive method available. 
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The standard method of evaluation within educational circles is the 
survey (Arbuckle, 1953), with the most prevalent survey technique being the 
mail questionnaire (Parten, 1966). The mail questionnaire offers a number of 
advantages over other survey techniques, including cost (Sudman, 1967; Hochstim, 
1967; Bachrack and Scoble, 1967), amount of time and energy required (Plog, 1963), 
convenience for the respondent (Eigelberner, 1926), surveying a broad geographical 
range of respondents (Clausen & Ford, 1947), and elimination of interviewer bias 
(Franzen and Lazarsfeld, 1945). However, despite these advantages, the mail 
questionnaire suffers from the problem of nonresponse. Mail questionnaires are 
based upon the principle that responses from a random sample of a population 
permit the researcher to draw valid inferences about the entire population. 
However, if only some of the random sample responds, their responses may not be 
representative of the entire sample, let alone the population. Nonrespondents 
have been observed to differ from respondents on a number of characteristics 
(Kawash & Aleamoni , 1971; Shuttleworth, 1941; Abeles, Iscoe and Brown, 1954; 
Bachrack and Scoble, 1967; Hochstim and Athanasopoulos , 1970; Franzen and 
Lazarsfeld, 1945). 

The problems and biases caused by nonresponse lend themselves to some 
solutions. Obviously, the primary method to deal with nonresponses is to reduce 
the size of the nonrespondent group by maximizing responses. One of the methods 
to maximize response rate is to employ vigorous follow-up procedures (Abeles, at al., 

— : --1954-;-Edgerton,-Britt-.-and-Norman,---lS47_;.-S.cojtt,J.9M)_.._Jt^^ 

procedures necessitate increased expenditures of time, money and energy, followups 
tend to work against some of the advantages of mail questionnaires. 

Perhaps the ideal method to reduce nonresponse bias is to maximize the 
initial rate of return of the mailed questionnaire. The bulk of empirical research 

O 
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designed to determine means to maximize the initial rate of return has 
centered around the contributions to response rate of various mechanical and 
perceptual devices (Linsky, 1965). Among the variables that have been studied 
in published research are: Offering incentives or rewards (Hancock, 1940); 
color of stationery (Gullahorn & Gullahorn, 1963); different classes of mail, 
and different types, denominations and colors of postage of either the return or 
outgoing envelope (Champion & Sear, 1969; Clausen and Ford, 1947; Martin & 
McConnell, 1970; Plog, 1963; Roeher, 1962; Scott, 1961); use of a po^t card 
reminder (Ferriss, 1951; Sletto, 1940); guarantees of anonymity (Mason, Dressel 
& Bain, 1961); use of a deadline date (Ferriss, 1951; Roeher, 1963); and 
length of questionnaire (Mason, et al . , 1961; Sletto, 1940; Champion & Sear, 1969). 
Scott (1961) provides a comprehensive literature review on various means to re- 
duce nonresponse. The research on those variables with direct bearing on the 
current study (types of signature, status of researcher, and type of reproduction) 
will be discussed in greater detail.. 

Survey research texts, as well as empirical research, support the idea that 
the cover letter should be both concise, personal and attractive (Hancock, 1940; 
Lundberg, 1929; Parten, 1966; Goode and Hatt, 1952). Odum & Jocher (1929) report 
that when the questionnaire has very few questions, the questionnaire is some- 
times made part of the cover letter. 

Research on the singature on the cover letter centers around varying the 

signature between a handwritten (ink) signature and a mimeographed facsjmjle^ 

Linsky (1965) surveyed members of a state nurse's association, and found that 
handwritten signatures and salutations on the cover letter brought greater 
returns th&n did mimeographed signatures and salutations. Weilbacher & Walsh 
(1952) surveyed members of a Columbia University professional fraternity and 
found no significant differences on the return rate of cover letters with personal 
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signatures and non-personalized signatures. Kawash & Aleamoni (1971) examined 
the effects of personalized signatures in a survey of faculty members on audio- 
visual materials. They found no significant differences between the return rates 
of ink and mimeographed signatured cover letters. Clausen & Ford (1947), in a 
followup to a survey of veterans also found no differences between an ink signa- 
ture and a mimeographed facsimile. Thus, despite statements in survey research 
texts, the use of ink signatures on the cover letter does not seem to guarantee 
higher response rates. 

The effects of varying the status of researcher on the return rates has 
received virtually no empirical study. Roeher (1963) found that using a ficti- 
tious title brought in more returns than did the use of no title. Kawash & 
Aleamoni (1971) suggest that the status of the researcher may be a relevant 
variable influencing return rate, but could find no other research covering the 
effects of varying the status of the researcher on the return rate of mailed 
questionnaires. 

The variable of the method of reporduction of the cover letter has produced 
conflicting research findings. Martin & McConnell (1970) found no significant 
differences in return rate between individually typed and mimeographed cover 
letters in a survey of attitudes toward crime and the legal system. In surveying 
motorcycle owners, Scott (1961) found no significant differences in the return 
rate of questionnaires with photocopied and mimeographed cover letters. However, 
Simon (1967) found that pe r^onaTly typed co ve r 1 ette rs brbugh t"i"Ojbren^etlJrn^ 
than did form letters, and Moore (1941) surveyed school superintendents and 
concluded that typewritten cover letters brought more returns than did duplicated 
letters. Panos and Rice (undated) surveyed college students and found that 
autotyped letters brought more returns than did mimeographed letters, but they 
^ did not portion out the personal - impersonal signature variable. 
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Despite the widely held view that a "personal touch" In the cover letter 
will Increase the response rate of a mailed questionnaire, empirical research 
Is often conflicting. Personalization of the signature on the cover letter, 
the status (title) of the researcher, and the personalization of the method of 
reproduction of the cover letter have never been studied simultaneously. The 
present study was an Investigation of the effects of type of reproduction of the 
cover letter and questionnaire, type of signature on the cover letter, and 
status (title) of researcher on the Initial rate of return of a mall questionnaire. 

Method 

A sample of 600 faculty members of the University of Maryland, College Park, 
was selected. Two hundred faculty members from each of the three professional 
ranks (Full, Associate and Assistant Professors) were sent an anonymous, one-page 
combination cover letter and five-item questionnaire. The 600 subjects (Ss^) were 
randomly assigned to one of 10 treatment groups and each group had 60 Ss_. , 20 
of each rank. The experimental variables were: Types of signature (ink or 
mimeographed facsimile); Types of reproduction (typed, photocopied or mimeographed); 
and Status of Researcher ("Professor of Educational Psychology" or "Graduate 
Student"). Forty percent of the 600 cover letters were mimeographed, 40% were 
photocopied, and 20% were produced on an IBM Selectric Magnetic Tape IV typewriter. 
One half of all cover letters were signed by a Professor of Education and Psy- 
chology and one-half were signed by a Graduate Studentt each formally noting 

the1r~titTeT~Sixty" percent-of aVT cover"Tetters-we re-hand-si gned~1n-1nk-(-al~l 

that were typed plus one-half of those photocopied and mimeographed) with the 
researcher's name; 40% had a mimeographed facsimile signature. All cover letters 
signed In ink were personally signed by the professor and the graduate student 
rather than by assistants. Table 1 shows the design of the study, as well as the 
return rate for each treatment group. 



BEST COPY AVAILABLE 

The cover letter and questionnaire and a self -addressed postage-free 
envelope were sent in a typed envelope to each S, via campus mail, an internal, 
postage-free mail service for the campus. All questionnaires were mailed to 
the office; all returns were mailed to the University Counseling Center. 

Data were analyzed using x'^ at the .05 level. 

Results and Discussion 

The initial (i.e., pre-followup) return rate was 69% (N=412). Chi-square 
analyses between Returned and Not-Returned questionnaires, along the Status, 
Signature, Reproduction, Professional Rank and Treatment Group variables were 
performed, but none were significant at the .05 level. 

A discriminant analysis for two groups was conducted, in an effort to 
discern which of the experimental variables best discriminated between the Ss_ 
who returned the questionnaire and those who did not return the questionnaire. 
Again the results showed no significant difference (F at .05). 

Neither the status of the researcher, the method of reproduction, nor 
the type of signature resulted in significantly different return rates. Addition- 
ally, these nonsignificant differences held up for all three professional ranks. 
Hence, contrary to some survey textbooks and commonly held beliefs, the "personal 
ization" dimension, as measured by the signature, status and reproduction 
variables seems to have little effect on the rate of return of a questionnaire 
mailed to college faculty members. The genaralizability of these results to 
other populations with other content and length of questionnaires remains open 
to further empirical study. 

■ Kawash and Aleamoni (1971) indicate that combinations of variables might 
possibly result in return rate differences, and they suggest the status of the 
researcher as potentially important as a variable. However, when signature 
personalization, status, and reproduction were studied in combination, none of 
these variables produced significantly different return rates in the present 
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study. 

The significance of these findings lies in the fact that it no longer 
seems necessary to personally hand-sign cover letters, nor to have the signature 
of a prestigious official. Thus the advantages of the mail questionnaire, in- 
cluding cost, time and energy, could all be accentuated by using a mimeographed 
cover letter, with the facsimile signatue of, say, a graduate student. Since 
signature, status, and reproduction do not seem to be particularly relevant 
variables, perhaps such intangibles as the respondent's interest in the topic 
and mood when receiving the questionnaire are worthy of study. At any rate, 
it appears that at least for faculty members, the initial return rate will not 
be significantly affected by using the most efficient, least expensive method 
available. 
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Table 1. 

Design of the Study and Initial Return Rate for Each Treatment Group 



Treatment Group Status Signature Reproduction Return Rate 



Number 










N 


% 


1 


60 


Professor 


Ink 


Photo 


42 


70 


2 


60 


Grad Stud. 


Ink 


Photo 


43 


72 


3 


60 


Professor 


Non-ink 


Photo 


46 


77 


4 


60 


Grad Stud- 


Non-ink 


Photo 


41 


68 


5 


60 


Professor 


Ink 


Mimeo 


40 


67 


6 


60 


Grad Stud. 


Ink 


Mimeo 


40 


67 


7 


60. 


_ Professor 


Non-ink 


Mimeo 


37 


62 


8 


60 


Grad Stud. 


Non-ink 


Mimeo 


35 


58 


9 


60 


Professor 


Ink 


Type 


41 


68 


10 


. 60 


Grad Stud. 


Ink 


Type 


47 


78 



*Each group had 60 Ss^, 20 Full Professors, 20 Associate Professors and 
20 Assistant Professors. 
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